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• • Linda Flower apd John Hayes have never, conducted a protocol. .analysis on my 

composing process. But if the^'dioVthey'd" learn just how essential -water ; 
cupboards, .aad basketball are' for writing. You see, i do my best prewriting 
while standing in the shower; and whejr wrTfyig becomed tedious, -J clean cup- 
board's—a task I despise so muchfthat \ eagerly return to pen^and paper; and* 
oftce I've revised and retyped a pagey*f take great pleasure in wadding up the 

^ old one and banking my shot off the Refrigerator, into the wastebasket.^ut of 

p * ' • V - 

What use is this description of t my composing process? Should I teach my stu- 

•' - • * . \ i ' 

dents that cleanliness is next to godliness ifo hopes of improving their pre- 

i. . , ' - - ' 

writing strategies? Probably not. What I am trying to illustrate by revea.ling 

• * 

my composing idiosyncrasies is that translating descriptive research directly. 
. ' into classroom practice may lead to some very unproductive teaching. 

Descriptive research allows us to learn about the composing processes of 

V 

individual writers and to formulate theories' and models,, but it provides 
t " limited direction for translating what we've learned aVout the composing pro- 

cess to teaching. ^ Therefore, we need additional research methods to enable us„ 
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mak^ sound pedagogical decisions. Experimental research designs provide*, 
such methods. ' To support this contention, I will first describe briefly the 



range of research methods available for investigating the . composing process;' 
0| ' then I 'will discuss the advantages of conducting experimental research; and 
- finally I will illustrate these advantages by summarizing a true experiment 
<9 * recently conducted at. Purdue* Uni^sitv. ' -permission to reproduce this . 
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writing strategies? Probably not. What I am tryirfg to illustrate by revealing 

my composing idiosyncrasies is that translating descriptive research directly. 

into classroom practice may lead to some very unproductive teaching. 
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^ * *First, let's rev.iew the kinds of research applicable to studying the com- 

posing process, -There are" two broad categories: descriptive studies^and ex- 

* • • % I 

perimental methods. We conduct Jhree main kinds of descriptive studies in com- 
position: qualitative descriptive studies;- quantitative, systematic descrip- 
tive studies; and prediction and classification studies. 

S 1 

*. u ^e qualitative descriptive studies , the -first category, to investigate 
how writers compose. A variety of research methods can be used to structure 
careful observation. The case study approach used by Emig and by Sommers and 
the. protocol analysis ^procedures used by Flower and Hayes are examples -in this 
category. 

We*use' quantitative, systematic descriptive studies , the^second category, 
to develop methods** for identifying and measuring characteristics of writing. 
Kellog Hunts descriptive work on how T-unit length varies with syntactic 
maturity is an example of a quantitative systematic study. 

We use prediction and classification studies , the third category, to f Re- 
cast student perforrnance* or v label students according to writing ability.^ Using 
-test scores, grades, or writing samples, we employ* prediction or classification 
methods to assign students to remedial, general, or advanced composition. 
Lately the bulk of -our research 'in* composition has b£en descriptive studies- 
v 'The second, category of- research we conduct is experimental. We uie ex- 
-perimental research to gauge the- effects our teaching methods -have on student 
writing performance; [ Although a variety' of experimental design^ exist, I will 
fociis\on the kind ca)}ed true experiments. Don't b^ misled by this nornencla- 
tune.'. It does not imply that descriptive studied and other ' experimental, de- 
signs, are false. - Rather the design of a true experiment .allows us to use 
S-implj^r .statistics and to make stronger cause and effeqt statements than'we 
-can use 'and make with other research designs. True experiments, such as the ■ 



research on sentence combining conducted by Frank O'Hare, have three require- 
ments:* (1) Randomized treatment and control groups fqr -comparison. Randomiza- 
tion -is a procedure whereby all students have/an equal opportunity to be 'in 
either group. It allows us to assume that the group's ,do not differ" initially 
except by chapce. 2) A treatment. This might typically be special instruction 
for the treatment group; and. 3) A .method for measuring differences between the 
groups following the treatment. Measurement methods for composition may fn- 
elude helistic or analytical storing of writing sanfiples i% 

In their introduction to* Research # on Composing: Points of Departure , 
Charles Cooper and Lee Odell persuasively argue the fallacy* Qf . conducting^ * 
experimental "research to 'discover the best methods for teaching composition 
when we knofw so littl^ about the composing process 'itkejf? Instead, they, call 
for descriptive studies. ' While their ^argument is persuasive, it was made five' 
years ago. Since then descriptive studies by Flower *and Hayes, Kroll? * 
Shaughnessy, Sommers, StalJ^rd and numerous others have given us a wealth of 
information oft how writers "of different' ages and abilities compose. -What we 
must begin to do now, in an .informed way, is apply our knowledge of . the 
composing .process to 4 teaching. True experimpnts^can ^provide a useful 

complement to descriptive' research* in composition/ 
• * * 

Conducting true experiments has several advantages, I will discuss' four. 
Conducting true, experiments: * . , 

* increases our knowledge of rel«t<*d research: in composition. 4 

• ( s . 

. ' * encourages careful planning, close attention to classroom proce- * > 
dures, and systematic evaluation. _ • . . 

* * »' * 

# * allows us to. better test the .effects" of our, teaching methods; 

*' promotes' a clearer understanding of research rnetjpdc^logy. 



•. First, let's consider h.ow conducting true experiments increases our knAwl - 
'edge of related research in-eomposition. We can do^sp by asking, "Where do the 
topics 'for experimental research and .the. methods- for classroonntreatments* come 
from?" Topics emerge from thorough descriptive research. Alert teachers who- 
are conducting and reading about descriptive studies begin to. notice gaps or 
discrepancies between what they're observing aj| wha,t-.»s being taught in the 
classroom. For instance, orte topic that's' prominent in composition journals 
and books to8ay is the relationship between speaking and .writing. Our profes- 
sion is divided on the usefulness of developing writing and speaking as com- 
.pTementary verbal abilities. On one hand; Emig, Sonmers and others contrast 
writing with speaking. On the other hand, most of the authors in the 1981 NCTE 
publication Exploring Speaking-Writing Relationships': Connections and Con- 
trusts, view speaking and writing as complementary activities intimately re- 
lated in the development of thinking, learning, and the mastery of verbal 
performance, # Such dissonance alerts us to suitable topics for experimental 
studies. * ; 

Afterf. carefully reviewing descriptive' literature and formulating a tenta- 
five theory about how our findings might translate to teaching, we are re^dy to 
design an experimental study. To do so, we vtill return to, the literature, this 
time to search for related experimental research. For example, if we were to 
continue investigating speaking/writing relationships/ we would find two re- 
lated experimental studies: Tovatt t and'Miller conducted an experiment testing ' 
their oral, aural, and visual pedagogy, and Radcliffe outlined an experimental 
design to, felt Zoellner's talk-write model. However, because true experiments 
are seldom conducted in composition, we can learn from any well-designed study 
how-to administer our; treatments, control extraneous classroom variables, and 
establish, measurement procedures. Thus, c.onducting true experiments is bound 



J 4 

to increase oy/ knowledge of related descriptive and experimental research in 

I . > - ■ , * 

composition. • ' . .•» ^ } 

But it ; 's not a matter of increasing knowledge "for the sake of knowledge. 

Conducting true experiments" encourages careful planning, close attention to 

J ■ ' ■ ■ . * ' 

classroom, procedures, and systematic evaluation, a second advantage of'exper'i- 

mental Research. When designing an experiment, we judiciously decide what to 

teach. and how." We prepare/course materials, jplan lessons, and maybe even alter «■ 

- oVir teaching' style 'with a particular theory in mind. disestablish' in advance '( 

the criteria'for measuring performance.' Although thest may also Jbe routine 

# f * • . 

I * *** * 

activities in teaching', when we combine research and teaching, our work takes 
on an added dimension.. We do morte long-range, detailed p-lanning; we take added 
care in designing materials arpTstructuning classroom activities; we may e#n ' 
rehearse a class' presentation. We also clearly define and justify our methods 
of evaluation. Overall, conducting tru'e .exper.'imenYs-makes us mor,e mindful of 
our role as telphers and more attentive to the needs and respond of our stu-. 



! 



dents. " * * v 

<3t " f 



Careful planning and close attention to classroom procedures pay off by 

allowing us to^better test the effects of our teaching. methods, a third advan- ■ 

> ■ • , »* 

. ■ .tage'of conducting "true experiments. Because we randomize* treatment and con-, 

V * 

tVol groups and assume equality -«f groups at the beginning of a true' experiment 
* and because we. carefully control the , variables and apply a specific treatment * 

\ during the experiment,' we can attribute differences between the groups at the * 

^ end the experiment 'to* trte treatment. What this means is that we how, have a 
\ better way to' Assess the effects of our teaching methods. Instead of saying., 
' , . J "I taught writing this way once. .and students wrote pretty gbod papers," we cat/ 
more preatsejy. define *uhat""this way" means, fliore exactly describe what "pretty 

*» , * . * 



good papers' 1 are;* and more confidently know that improvement is a result *of our 

» • ♦ 

teaching, not the. result of ao overlooked -Vari-alxle such as student motivation. 

Conducting true experiments a1so"prombtes a clearer understanding of re- 

> - f ' 

search methods, a fourth advantage. The adage- "learn by do'ing"' is particularly 
germane to conducting true experiments. By sti/dyuig the literature, 'selecting 
and narrowing a topic, formufatiog a tentative' hypothesis, specifying* treat- 
ments, establishing criteria for measurement, and actually planning and_con- 
ducting a true experiment,, we learn, first hand the* requirements of good experi- 



mental research and tan more critically interpret the research of others 

% '" I will t^ow illustrate these advantages by summarizing a true experiment 

-that Jeanne- Halpetn and I recently conducted at Purdue University. Ou.r re- 

search began when we started noticing gaps between descriptive research in 

i composition, real-world practice, arid "classroom teaching. In our reading, we 

found researchers .who,' like John ^chafer* , believe-that "a particular kind of ' 

oral language transference ca*i i, help, not hurt*writing." In our consulting, in 

« business and- i ndustry, we heard on-the-job writers who xhose to dlctata their 

t communications express difficulties ^associated with speaking writing effective- 

ly. In addition, they of.t'en produced letters' and memos wi.th peculiar errors 

. when- dictating fdr word, processing systems. And in our bus jne-ss^writi ng class- 

■ ' • » : ' • 

. r^ms, we realized our textbooks focused entirely on the more" technical aspects 

. ■(■ / - 

t of dictation such as us-ing the equipment and. speaking clearly. They ignored 
. , * , the composing strategies necessary for usin4 the' new* systems.- At '.this point we 
-..decidedto conduct our own descriptive study to learn if 'dictation/word- pro- ] 

I :■' . •• • 

i cessing systems require a composing process somewhat different from that* of 

# * , 

wri.ting". Using a c-ase approach, we interviewed. 28 dictators in business and * 

»/ 

„ industry to determine thei^ dictation process.. We then analyzed our finding's * 
and' identified key differences between the processes of dictation! and writing,. - *.' 
•John C- Schafeiv "The Linguistic AnaJysis o-P Spoken and Written. Texts , v - f n , * V 
FR?r Roberta. J. V*r>», Urbana, lL: l/CTE, W ^ ^^^^^ • -\ • 

£SL ? , *• *-* * ? 

' ' . -» V- M~t- : V— --- 



especially .in the planning strategies. Thus. ,iiv preparation- for our true ex-, 
periment we le anted much about related research in composition. ■ We studied -the 
descriptive research of others on the composing process of. writing and its 

* ■ • 

relationship to speaking, and we investigated the composing process of dicta-' 
tors by conducting our^own descriptive study . 

Based on our exploratory research, we conducted a true experiment as fol- 

* * * 

lows. Our hypothesis was that students taught both 'the composing process and 
the technical process of dictation will produce significantly better dictated 
memos than those taught^only the technical process. While- this hypothesis may 
at first seem self-evident, it is based on two assumptions :' -1) dictation re- 
quires adaptations* in . the composing process of writing, with much heavier ■ 
emphasis on planning; and 2) students can learn make these adaptations. Our 
design included four classes-of business writing at Purdue University with two 
classes per ttfrne period. Two instructors, Jeanne and I participated, each 
teaching one- treatment and ohfy control group. We randomly assigned our sub- 
jects, eighty-ft»ur business writing students to either a treatment or a control 
.group. .We gave the treatment group four hours of training^in the composing 
process of dictation,, emphasizing planning. Duri-ng the same time period,, *we 
reviewed with the control' .group the rhetori'cal .context of the composing ^pro- 
cess, emphasizing writer, message, and audience.- In one .hour, we taught both 

v. ' : * 
grorfps the t more technical aspects of dictation and gave them time to practi 

using the, equipment, speaking clearly,- and addressing the transcriber. To mea- 

\ . 

sure the effects of atfr instruction, we exaaiined-students' performance on a 

<•.'•• 

dictated assignment as rated hoi istical.ly by tr-smted graders using rubrics we 
had developed. In summary, the Somponenjf of a true experiment/ are 'an ^hypo- 
thesis, "assumptions, a research design, ^domi zed subjects, a treatment, and 
measurement procedure. • * 



What did we gain by designing and conducting the, true experiment? About ' 
• planning, we learned how to. design materials and structure group activities to* 
illustrate the composing- process, of dictation. About teaching, we learned how 
l to help students* adapt their familiar writi/ig process to an unfamiliar dicta- 
tion process. * J\nd about evaluating, .we lear^ied how^o clearly articulate the 
features of a good- communication as we wrote the rubrics and trained graders in 
.holistic scoring. As"a result of our efforts, we have a* w£l*l -planned unit on 



tic 



ctation from lessons to assignments to evaluation that we can teach with con- 
dence. • ' .* i . • 



The reason we're confident that our unit on dictation teaches students ef- 
fective strategies for composing dictated communications is that the true ex- 
p^riment allowed us to compare groups' and test our f Hidings. After drained 
graders scored the memos, we' statistical ly compared the scores of the treatment* 
and control groups and learned that the treatment group dictated significantly 

* * r- 1 

J * ' y 

better memos. That learning to dictate is an important skill for college grad- 
uates is confirmed by the rapid conversion to dictation/word processi ng , systems 
in business, industry, and government. That learning composing strategies for 

dictation is essential to developing dictating skill is confirmed in our re- 

\ ■ - f 

searGh. *' * 

For Jeanne and m<e, conducting a true experiment gave us a clearer under- 

standing Q>f research methodology than we could ever have gained by reading the 

report^ of dthers. And ^s a result of this experience, we are better at>!e to 

4 

critically judge descriptive and experimental research in composition, < 

Td now like to summarize the advantages o'f 'conducting true experiments in 
composition. To clo so, Td like for you to coYvsider your response to this ex- 
cerpt f/om a memo dictated by a student in our^experiment. k 

Applicant 1 Applicant U shows no work experiences of any type. He 
was a high school drop out, and has only held a jotrfbr as long as; 



, three itfonths* at a time. -He admitted* he hated marrua1 v lftbor and ad- 
mitted tQ not liking to be around people period. v Hi"s attendance re- 
cord while, at* work was good, but I f ina it hard to, believe Re would . 
•have a good excuse for missing work when* you only worked "there 'for 
three months anyway. He expresses to continue his education,' but Is' 
just holding out to find out if he can get a job or* not. x Jhe more I 
learned from Applicant 1, in the interview, I feel our company* has no 
use^for. him on tfie' trai ning program. . \ „• r 

If we were conducting descriptive research', we m'ight' speculate ' that this stu- 
dent relies too heavi.ly on spedking~7kTTTs when dictating. The lack of paral- 
lei ism, inaccurate pronoun reference, inappropriate tense switches, and.vocabu- 
lary related, errors are characteristic of oral- discourse. But our speculation 
would be somewhat faulty. Speech is seldom so elliptical or marked by such an 

* * v 

odd mixture of stilted and casual diction. If we were col lecting'jJata from a 
t single group, of student's who had been taught only the technical process of .die- 
tation, which i& in fact the k'ind of training this student had received, we 
might infer that she was a poor writer, Even though she^ operated dictation 
equipment successfully, sh£ produced an illogical, ungrammat-ical communication-. 
But our inference would again be somewhat faulty, in fact, the student, a good 
writer, earned a B in the business wrjting class. Because we conducted*, a true 
experiment, however, we can conclude with confidence that tfjis student from the 
control group would byefit from learning the composing process of dictation ia 
<addit^on to trte technical process. By conducting* true experiments, w£ not only 
increase our . knowledge of related research in composition and research me'thod- 
plogy but more importantly we can test the effects of our planning and teaching 
through systematic evaluation^. Conducting true experiments in composition ac- 
complishes, doubje duty in our classrooms by creating a learning environment for 
our students and for our profession. 



